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(54) FORWARD MONITORING METHOD FOR VEHICLE 

(57)Abstract: 

PURPOSE: To judge a degree of danger due to a 
traveling vehicle and the like in front and other 
obstacles on the road automatically and at high 
speed by using a foreground image by a video 
camera without using a distance sensor for ^ 
measuring an inter- vehicle distance to the 
preceding vehicle. [ 
CONSTITUTION: Movement of the same point 
on an object shown in two frames of images 
chronologically continuing in a series of 
foreground animations is detected as an optical 
flow vector, and danger is judged by its size. A 
narrow window set in the radical direction from 
FOE of the previous image is moved in the same 
direction on the successive image, and the optical 
flow vector of a point to be aimed at is set as an 

arrow connecting each of the central points of the position of the window where the 
sum of absolute values of difference in brightness of the area on the successive image 
that the window overlaps the window becomes the minimum, and the set position of 
the window in the previous image. However, the point to obtain the optical flow is 
the only point that the difference in brightness between the previous and successive 
images exceeds a certain threshold value so that influence of landscape outside the 
road or a traffic lane, letters or characters drawn on the road should be eliminated in 
obtaining the optical flow. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by -the use of -this -transla-tion . 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the front monitor approach for cars 
for detecting a front car or a front obstruction in the case of transit of a car, and giving 
an operator warning using the image picturized with the video camera installed in the 
anterior part of cars, such as an automobile. 
[0002] 

[Description of the Prior Art] Conventionally, there are some which were indicated by 
ifor example, the Japanese-Patent- Application-No. No. 241855 [ two to ] official report 
as this kind of an approach. The approach indicated by this official report photos a 
foreground from the self-car it is running, recognizes migration of the same point of 
this photoed foreground as an optical flow for every predetermined time, acquires the 
information which consists of a location of the precedence car to a self-car, and 
relative velocity based on the distance robot which measures the distance between two 
cars of this optical flow and a front car, and when this information is judged to be 
dangerous on a basis, it tells an operator about that. 

[0003] Moreover, in order to ask for an optical flow, the technique called the matching 
method which detects a point between the images of two coma was adopted 
conventionally. As this matching method takes an aperture Wl to the pixel P which 
pays its attention on the image in t the time of being shown in drawing 9 (a), and it 
calculates a correlation value, moving an aperture to the whole region in an image, or 
a surrounding field and it is shown in drawin g 9 (b), the point of an aperture W2 that 
the correlation value became max is searched for as corresponding points Q, i.e., a 
corresponding pixel, and this PQ (arrow head) serves as an optical flow. In order to 
calculate the above-mentioned correlation value sigma(Wl (x y) xW2 (x y))/ 
(sigmaW12 (x y)xsigmaW22 (x y))l/2 .... (1) 

Becoming count is performed. In addition, Wl (x y) and W2 (x y) It is the output of 

the coordinate (x y) in an aperture Wl and W2. 

[0004] 

[Problem(s) to be Solved by the Invention] However, by such conventional approach, 
in addition to the video camera which photos a foreground in order to judge risk, in 
order to know the location of the precedence car to a self-car, the distance robot for 
measuring the distance between two cars with a front car is also needed for 
coincidence. 

[0005] Moreover, as mentioned above, in order that it is necessary to perform data 
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processing of detecting a point between the images of two sheets but in order to ask 
for an optical flow, and this data processing may detect a certain corresponding points 
of one point, it is said to 1 pixel of an image that it searches to all the pixels of all the 
fields in an image, or a surrounding field. In order to detect corresponding points over 
the whole image, this processing must be performed to all pixels. Moreover, many 
count is needed also in order to calculate the correlation value used as an index in 
order to search. 

[0006] Therefore, since a processing unit high-speed in order real-time-izing is 
difficult since computational complexity becomes huge, or to realize is needed, the 
problem that equipment itself will form an expensive rank is raised. Moreover, the 
trouble that it is difficult to distinguish that it will not be generated fi-om the part of a 
precedence car and that the optical flow will arise neither fi-om an alphabetic 
character, nor a notation or a white line on the scenery outside a road or a road surface 
is also got. 

[0007] Therefore, this invention aims at offering the front monitor approach for cars of 
having enabled it to judge automatically the danger by a fi-ont transit car and other 
fi:*ont obstmctions, using the foreground image from the video camera installed in car 
anterior part, without measuring the distance between precedence cars in view of the 
conventional trouble mentioned above. 

[0008] Moreover, this invention aims at offering the front monitor approach for cars of 
having enabled it to recognize migration of the same point at a high speed as an 
optical flow for every predetermined time in the foreground picturized with the video 
camera. 
[0009] 

[Means for Solving the Problem] The front monitor approach for cars made by this 
invention in order to attain the above-mentioned purpose Picturize a foreground from 
the self-car it is running, and it recognizes as an optical flow based on the image of 
two coma which carries out migration of the same point of this picturized foreground 
before and after a predetermined time phase. In the front monitor approach for cars 
which supervises the precedence car or obstruction to a self-car based on this optical 
flow, it is characterized by judging danger with the magnitude of said optical flow of 
the point of said precedence car or a failure lifter. 

[0010] The long and slender aperture centering on one of them is set up in the 
direction of a radial to one point noted from the infinite point corresponding to one 
point which shows the travelling direction of the self-car it is running in the above- 
mentioned front monitor approach for cars in the image of before in the image of two 
coma carried out before and after a predetermined time phase. It is characterized by 
asking for total of the absolute value of a brightness difference with the aperture in the 
image of said front, and asking as an optical flow of one point which pays its attention 
to the movement magnitude of an aperture when this total becomes min, moving this 
aperture in the radiation direction from said infinite point in a next screen. 
[001 1] In the above-mentioned front monitor approach for cars, it is characterized by 
searching for a brightness difference by the image of two coma carried out before and 
after a predetermined time phase, and asking for an optical flow about the point 
beyond a fixed threshold with this brightness difference. 

[0012] In asking for an optical flow, in the above-mentioned front monitor approach 
for cars, it is characterized by removing the optical flow produced from the scenery 
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outside a road, the lane of a road surface, an alphabetic character, a notation, etc, 
[0013] In asking for an optical flow, the field equivalent to the scenery outside a road 
is set up beforehand, and it is characterized by not processing the this set-up field. 
[0014] It has the video camera which picturizes a foreground from the self-car it is 
running, the height from the lane on the road surface which the optical flow has 
produced based on optical flow information, an alphabetic character, a notation, etc. to 
a video camera is found, and this height is characterized by removing the optical flow 
which is in agreement with the height of the camera from a road surface. 
[0015] The field appointed beforehand is divided into two or more areas, weighting is 
carried out for every area to total of the die length of the optical flow vector which 
exists in each area, and it is characterized by judging the degree of risk with this value 
that carried out weighting. 

[0016] A predetermined threshold is set up for every area and it is characterized by 
judging the area where said total of optical flow vector die length by which weighting 
was carried out exceeded this threshold to be dangerous. 

[0017] Said threshold consists of number level and it is characterized by judging the 
level of danger with the level of the threshold which said total of optical flow die 
length by which weighting was carried out exceeded. 

[00 1 8] It is characterized by emitting an alarm according to the magnitude of the 

danger searched for. 

[0019] 

[Function] Since he is trying to judge risk paying attention to an OPUI cull flow 
becoming large with the magnitude of the optical flow of the point of a precedence car 
or a failure lifter on the street so that relative velocity is so large that distance with a 
precedence car or an obstruction is small according to the above-mentioned approach, 
it is unnecessary to form the range finder for measuring the distance between 
precedence cars exceptionally. 

[0020] An optical flow sets in the image of the front of the images of two coma paying 
attention to being formed in the direction of a radial from the infinite point 
corresponding to one point which shows the travelling direction of a self-car. Setting 
up a long and slender aperture in the direction of a radial to one point to note from the 
infinite point corresponding to one point which shows the travelling direction of the 
self-car it is running, and moving this aperture in the radiation direction from said 
infinite point in a next screen It asks for total of the absolute value of a brightness 
difference with the field of the image after lapping with the aperture and this aperture 
in an image of said fi^ont. Since he is trying to determine the arrow head which 
connects between each central point of the location of an aperture when this total 
becomes min, and the setting location in the image in front of this aperture as the 
optical flow of one point, it becomes mitigation of computational complexity and 
processing can be accelerated. 

[0021] since a brightness difference be search for paying attention to there be a 
location which do not have time brightness change like the empty include in an image 
or a road surface by the image of two coma carry out before and after a predetermined 
time phase and he be try to ask for an optical flow about the point beyond a fixed 
threshold with this brightness difference , the number of the points in the image which 
ask for an optical flow decrease sharply , and can accelerate by become possible to 
exclude useless processing . 
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[0022] In order to remove the optical flow produced from the scenery outside a transit 
schedule lane in asking for an optical flow, the field equivalent to the scenery outside 
a transit schedule lane is set up beforehand, and since it is made not to process the this 
set-up field, the processing time is accelerable. 

[0023] The lane and alphabetic character on the road surface which was equipped with 
the video camera which picturizes a foreground from the self-car it is running, and the 
optical flow has produced using optical flow information, By finding the height from a 
notation etc. to a video camera, and removing the optical flow this whose height 
corresponds with the height of the camera from a road surface Only the optical flow 
produced only from the vehicle besides the front and the obstruction can be processed, 
and the processing time is accelerable while becoming possible to get to know danger 
using an optical flow. 

[0024] Since the field appointed beforehand is divided into two or more areas, 
weighting is carried out for every area to total of the die length of the optical flow 
which exists in each area and existence of risk is judged with this value that carried 
out weighting, it can know in which location risk is. Moreover, a predetermined 
threshold is set up for every area, the area where total of optical flow vector die length 
exceeded this threshold is judged to be dangerous, and sweet red bean soup with 
mochi can do danger for every area. Furthermore, a threshold consists of number 
level, and he judges the level of danger with the level of the threshold which total of 
optical flow vector die length exceeded, and is trying to emit an alarm according to the 
magnitude of the danger searched for. 
[0025] 

[Example] Hereafter, the example of this invention is explained based on a drawing. 
Drawing 1 shows the configuration of the equipment for enforcing the approach by 
this invention, the video camera with which 1 picturizes a foreground in this drawing, 
and 2 input the image obtained with the video camera 1, and the processing unit which 
performs the image processing mentioned later, the speedometer with which 3 
measures the rate of a self-car, the processing unit which 4 inputs the image- 
processing result of a processing unit 2 and the self-car rate obtained from a 
speedometer 3, and performs danger judging processing, and 5 are alarms. 
[0026] Drawin g 2 is drawing for explaining change of the foreground image obtained 
with a video camera 1 , and the image which the video camera 1 picturized by time 
amount t in the situation containing the self-car which shows (b) to (a), and the image 
which picturized (c) by time amount t+delta t are shown, respectively. 
[0027] Now, a self-car presupposes that the flat path is gone straight on. For example, 
if the road sign and building which are shown in (a) are observed, an image as shown 
in (b) and (c) in time amount t and time amount t+delta t by the passage of time will 
be obtained. If they are connected in search of the point of corresponding in this image 
of two sheets, a velocity vector as shown in (d) will be obtained. This is an optical 
flow. 

[0028] These optical flows appear in a radial from one point called FOE in an image 
(Focus of Expansion) here. It corresponds to one point which shows the travelling 
direction of a self-car on an image in FOE when it is called an infinite point or a 
vanishing point and the car is going straight on. Thus, the optical flow called for when 
the self-car is running is the direction of FOE to a radial. The optical flow emitted 
from the precedence car here includes the information which consists of a location of 
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the precedence car to a self-car, and relative velocity, and it is considered that danger 
is high, so that an optical flow is long. 

[0029] Next, the detail is explained with reference to drawin g 3 . optical arrangement 
of this drawing — if it is and 1 1 considers as the lens of a video camera, and the point 
corresponding to [ 12 / f/ the image plane of a video camera, and / corresponding to 
one point of the arbitration of a precedence car or a failure lifter in the distance from 
the lens 1 1 to the image plane 12, and P (X, Y, Z) ] the point P on the image plane 12 
in p (x y) — from the ratio of similarity of three square shapes x=f-X/Z .... (2) 
It becomes. 

[0030] If this formula is transformed and time amount differential is carried out X — 
(deltax/deltat-Z+x-Z')/f .... (3) 

It becomes. Moreover, the x direction components u of an optical flow 
U-deltax/deltat .... (4) 

It comes out, and since it is, this is used. Z=(f-X' - x-Zyu .... (5) 
It becomes. 

[0031] Here Relative velocity of a Z — precedence car thru/or an obstruction and a 
self-car = -alpha .... (6) 

Since come out and it is, it is an upper type (5). Z=(f-X'+xalpha)/u .... (7) 
It becomes. Therefore, the x direction components u of an optical flow u=(f- 
X^+xalpha)/Z .... (8) 

It becomes. It can be similarly found about Y. 

[0032] Therefore, from a top type (8), as for x components of an optical flow, the 
relative velocity of size, i.e., a precedence car, becomes large so that Z is [ the distance 
to smallness, i.e., a precedence car, or an obstruction ] smallness, or, so that alpha is 
size. This is the same also about the direction of Y. Therefore, an optical flow 
becomes so long that so size [ relative velocity ] still that it is **** in distance with a 
precedence car etc., and the direction when longer than the time when an optical flow 
is shorter than this is considered that the danger over a precedence car or an 
obstruction is relatively large. 

[0033] By this invention, use that the sense of a radial is asked for an optical flow 
from FOE, he is trying to ask a high speed for an optical flow, and the approach is 
explained below based on drawin g 4 . 

[0034] Drawin g 4 is drawing having shown one example of the approach of asking a 
high speed for an optical flow. First, a long and slender aperture is set up in the 
direction of a radial from FOE to one point first noted in the image in time amount t 
( drawing 4 (a)). Next, it asks for total of the absolute value of a brightness difference 
with the aperture in time amount t in the image in time amount t+delta t, moving an 
aperture one point at a time in the direction of a radial from FOE. And the movement 
magnitude of an aperture when total becomes min is calculated as a velocity vector of 
one point to which its attention is paid ( drawin g 4 (b)). In addition, the above- 
mentioned brightness difference is a thing between the pixels of the corresponding 
location shown in (a) and (b) by O about each pixel which constitutes an aperture. It 
can ask for the optical flow of the whole image by performing the above processings 
repeatedly in all the points of the image of time amount t. 

[0035] Moreover, by the conventional approach, when corresponding apertures were 
compared, the cross-correlation value was used. Since total of the absolute value of a 
brightness difference is used by the approach of this invention to it, it becomes 
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mitigation of computational complexity and processing can be accelerated. 
[0036] Further, it is asking for the velocity vector from not all the points in an image, 
and a difference is searched for and it is made to process by the image of time amount 
t and time amount t+delta t in this invention only to the point beyond the fixed 
threshold which is the difference. 

[0037] Generally, the image which projected the foreground during car transit has 
many locations which do not have a time brightness change like empty or a road 
surface. Asking for an optical flow theoretically is impossible in such a location. 
Therefore, like the approach of this invention, within the image in time amount t, and 
the image in time amount t+delta t, if it is, it is accelerable by becoming possible to 
exclude useless processing by [ which is a brightness difference ] processing paying 
attention to things. 

[0038] A high speed is asked for an optical flow by approach which was mentioned 
above. However, the optical flow produced by what is not obstmctions, such as 
scenery other than a road and a lane of a road surface, is contained in the optical flow 
which was able to be found here. Therefore, it is difficult to search for the danger by 
existence of a front obstruction or its obstruction using the optical flow currently 
called for here. Therefore, it is necessary to remove the optical flow produced from the 
scenery outside a road, or the lane of a road surface. Next, this approach is explained. 
[0039] Drawin g 5 is one example of the approach of removing the optical flow by the 
scenery outside a road. The location where the slash is drawn in this drawing shall not 
process in the other location noting that it shows a path on the street, by carrying out 
like this, since it begins, the optical flow produced from the scenery outside a road 
cannot be found in addition ~ and the processing time can be 

accelerated by restricting a field. 

[0040] Next, how to erase the mark on a road surface is explained using drawing. 
Drawing 6 is one example of this approach, and explains an optical configuration first. 
Drawing 6 is drawn instead of the car which installed the video camera going straight 
on, assuming that the whole road surface has approached. The lens of the video 
camera with which 1 1 picturizes the front, and 1 2 show the image plane of a video 
camera. 13 and 14 express the lane before and behind migration. The three-dimension 
coordinate which makes the core of a lens a zero, and the two-dimensional coordinate 
which makes Above FOE a zero on the image plane 2 are considered. 
[0041] The height to the video camera of the lane where the optical flow has produced 
the location of the lane before migration like [ similitude ratio / of two square shapes / 
three ] a formula (1) in P (X, Y, Z+deltaZ) and a Z direction if the location after 
deltaZ migration is set to Q (X, Y, Z) can be known. 
Y=y2 delta Z/fdeltay .... (9) 

The optical flow which height is in agreement with video camera quantity, that is, has 
produced by the mark on a road surface etc. is removable using this height information 
that was able to be found. 

[0042] Here, deltaZ is the distance which advanced between time interval deltat of the 
image of two sheets, and it can ask for it by getting to know a car rate. It becomes 
possible to remove the optical flow produced from other than the front obstruction by 
processing which was explained above. Therefore, a front obstruction becomes 
possible [ searching for the danger which shows how much it is risk ] from the 
location and die length of the optical flow left behind now. 
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[0043] Next, how to search for danger is explained. Drawing 7 shows one example of 
this approach. If a configuration is explained first, each field of I -IV shows the distant 
place of a self-lane, the method of Kon of a self-lane, the distant place of a next door 
lane, and the method of Kon of a next door lane, respectively. Weighting of the danger 
is carried out for every area to total of the die length of the optical flow which exists in 
each field, and it is searched for here with this value that carried out weighting. 
Furthermore, the predetermined threshold is set up for every field, and if total of flow 
die length exceeds this threshold, it will be judged that the field beyond a threshold is 
dangerous. Number level setting of the threshold is carried out, and the level of danger 
can also be judged. 

[0044] It becomes possible to be able to demand cautions from an operator by 
sounding an alarm at the end according to the magnitude of the danger searched for. 
Moreover, it also enables which field to indicate whether how many to be risk on a 
display. It is also possible to change classes, such as a tone of an alarm, with risk level 
furthermore. 

[0045] If the procedure of the image processing by the approach of this invention 
explained above is summarized and shown, it will become like drawin g 8 . First, the 
image in time amount t is captured in step S 1 , and then the image in time amount 
t+delta t is captured in step S2. After that, FOE is set up in step S3 and a processing 
field is set up in continuing step S4. Then, it progresses to step S5 and the field where 
the brightness difference exceeded the fixed threshold by the image of time amount t 
and time amount t+delta t here is extracted. It asks for an optical flow in the field 
progressed and extracted to step S6 after that, an optical flow path on the street is 
removed in the following step S7, and danger is calculated with the value which 
carried out weighting for every area in the following step S8 further. 
[0046] 

[Effect of the Invention] Since existence of a forward cardiac failure theory object or 
its danger can be automatically judged according to this invention as explained above, 
a safety operation of a car is attained. 

[0047] The video camera which picturizes a foreground from the self-car judges risk 
with the magnitude of the optical flow of the point of a precedence car or a failure 
lifter, and it is making and running especially is installed ahead [ one set ], and since it 
is unnecessary to form the range finder for measuring the distance between precedence 
cars exceptionally, it is realizable by low cost. 

[0048] Moreover, by limit of an abbreviation and a processing field etc., improvement 
in the speed of processing can perform mitigation of computational complexity, and 
useless processing, and real-time processing becomes easy about them. 
[0049] Furthermore, a hazard area and its degree are got to know, and the 
effectiveness of being able to emit a suitable alarm is acquired. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by -the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the front monitor approach for cars which picturizes a foreground from 
the self-car it is running, detects migration of the same point in the image of two coma 
carried out before and after a predetermined time phase as an optical flow, and 
supervises the relative relation between the precedence car to a self-car, or an 
obstruction on the street The front monitor approach for cars characterized by the 
thing of the size of the vector of the optical flow which appears to the point of said 
precedence car or a failure lifter on the street, and an appearance location for which 
danger is therefore judged how. 

[Claim 2] From the infinite point corresponding to one point which shows the 
travelling direction of the self-car it is running in the image of the front of the images 
of two coma carried out before and after a predetermined time phase Setting up a long 
and slender aperture in the direction of a radial, and moving this aperture in the 
radiation direction from said infinite point in a next image to one point to note It asks 
for total of the absolute value of a brightness difference with the field of the image 
after lapping with the aperture and this aperture in an image of said front. The front 
monitor approach for cars according to claim 1 characterized by determining the arrow 
head which connects between each central point of the location of an aperture when 
this total becomes min, and the setting location in the image in front of this aperture as 
the optical flow of one point. 

[Claim 3] The front monitor approach for cars according to claim 1 characterized by 
searching for the brightness difference of each point between the images of two coma 
carried out before and after a predetermined time phase, and asking for an optical flow 
only about the point exceeding a fixed threshold with this brightness difference. 
[Claim 4] The front monitor approach for cars according to claim 1 characterized by 
removing the optical flow produced from the lane which was drawn on the scenery 
outside a road, or a road surface in asking for an optical flow, an alphabetic character, 
a notation, etc. 

[Claim 5] The front monitor approach for cars according to claim 1 characterized by 
setting up beforehand the field equivalent to the scenery outside a transit schedule lane 
in asking for an optical flow, and not processing the this set-up field. 
[Claim 6] The front monitor approach for cars according to claim 4 that it has the 
video camera which picturizes a foreground from the self-car it is running, the height 
from the lane on the road surface which the optical flow has produced based on optical 
flow information, an alphabetic character, a notation, etc. to a video camera is found, 
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and this height is characterized by removing the optical flow which is in agreement 
with the height of the camera from a road surface. 

[Claim 7] The front monitor approach for cars according to claim 1 characterized by 
dividing into two or more areas the field appointed beforehand, carrying out weighting 
for every area to total of the die length of the optical flow vector which exists in each 
area, and judging the degree of risk by the size of this value by which weighting was 
carried out. 

[Claim 8] The front monitor approach for cars according to claim 7 characterized by 
judging the area where the predetermined threshold was set up for every area, and 
total of the die length of said optical flow exceeded this threshold to be dangerous. 
[Claim 9] The front monitor approach for cars according to claim 8 characterized by 
judging the level of danger with the level of the threshold which total of the die length 
of said optical flow exceeded by said threshold consisting of number level. 
[Claim 10] The front monitor approach for cars according to claim 9 characterized by 
emitting an alarm according to the magnitude of the danger searched for. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPl are not: responsible for any 
damages caused by -the use of t^hls t:ranslat:lon . 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



TECHNICAL FIELD 



[Industrial Application] This invention relates to the front monitor approach for cars 
for detecting a front car or a front obstruction in the case of transit of a car, and giving 
an operator warning using the image picturized with the video camera installed in the 
anterior part of cars, such as an automobile. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



PRIOR ART 



[Description of the Prior Art] Conventionally, there are some which were indicated by 
for example, the Japanese-Patent- Application-No. No. 241855 [ two to ] official report 
as this kind of an approach. The approach indicated by this official report photos a 
foreground from the self-car it is running, recognizes migration of the same point of 
this photoed foreground as an optical flow for every predetermined time, acquires the 
information which consists of a location of the precedence car to a self-car, and 
relative velocity based on the distance robot which measures the distance between two 
cars of this optical flow and a front car, and when this information is judged to be 
dangerous on a basis, it tells an operator about that. 

[0003] Moreover, in order to ask for an optical flow, the technique called the matching 
method which detects a point between the images of two coma was adopted 
conventionally. As this matching method takes an aperture Wl to the pixel P which 
pays its attention on the image in t the time of being shown in drawing 9 (a), and it 
calculates a correlation value, moving an aperture to the whole region in an image, or 
a surrounding field and it is shown in drawin g 9 (b), the point of an aperture W2 that 
the correlation value became max is searched for as corresponding points Q, i.e., a 
corresponding pixel, and this PQ (arrow head) serves as an optical flow. In order to 
calculate the above-mentioned correlation value sigma(Wl (x y) xW2 (x y))/ 
(sigmaW12 (x y)xsigmaW22 (x y))l/2 .... (1) 

Becoming count is performed. In addition, Wl (x y) and W2 (x y) It is the output of 
the coordinate (x y) in an aperture Wl and W2. 
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EFFECT OF THE INVENTION 

[Effect of the Invention] Since existence of a forward cardiac failure theory object or 
its danger can be automatically judged according to this invention as explained above, 
a safety operation of a car is attained. 

[0047] The video camera which picturizes a foreground from the self-car judges risk 
with the magnitude of the optical flow of the point of a precedence car or a failure 
lifter, and it is making and running especially is installed ahead [ one set ], and since it 
is unnecessary to form the range finder for measuring the distance between precedence 
cars exceptionally, it is realizable by low cost. 

[0048] Moreover, by limit of an abbreviation and a processing field etc., improvement 
in the speed of processing can perform mitigation of computational complexity, and 
useless processing, and real-time processing becomes easy about them. 
[0049] Furthermore, a hazard area and its degree are got to know, and the 
effectiveness of being able to emit a suitable alarm is acquired. 
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with the magnitude of the optical flow of the point of a precedence car or a failure 
lifter, and it is making and running especially is installed ahead [ one set ], and since it 
is unnecessary to form the range finder for measuring the distance between precedence 
cars exceptionally, it is realizable by low cost. 

[0048] Moreover, by limit of an abbreviation and a processing field etc., improvement 
in the speed of processing can perform mitigation of computational complexity, and 
useless processing, and real-time processing becomes easy about them. 
[0049] Furthermore, a hazard area and its degree are got to know, and the 
effectiveness of being able to emit a suitable alarm is acquired. 

[Translation done.] 



http://www4.ipdLncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



Page 1 of 1 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use o£ this translation . 

1 .This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3 .In the drawings, any words are not translated. 



TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, by such conventional approach, 
in addition to the video camera which photos a foreground in order to judge risk, in 
order to know the location of the precedence car to a self-car, the distance robot for 
measuring the distance between two cars with a front car is also needed for 
coincidence. 

[0005] Moreover, as mentioned above, in order that it is necessary to perform data 
processing of detecting a point between the images of two sheets but in order to ask 
for an optical flow, and this data processing may detect a certain corresponding points 
of one point, it is said to 1 pixel of an image that it searches to all the pixels of all the 
fields in an image, or a surrounding field. In order to detect corresponding points over 
the whole image, this processing must be performed to all pixels. Moreover, many 
count is needed also in order to calculate tiie correlation value used as an index in 
order to search. 

[0006] Therefore, since a processing unit high-speed in order real-time-izing is 
difficult since computational complexity becomes huge, or to realize is needed, the 
problem that equipment itself will form an expensive rank is raised. Moreover, the 
trouble that it is difficult to distinguish that it will not be generated from the part of a 
precedence car and that the optical flow will arise neither from an alphabetic 
character, nor a notation or a white line on the scenery outside a road or a road surface 
is also got. 

[0007] Therefore, this invention aims at offering the front monitor approach for cars of 
having enabled it to judge automatically the danger by a front transit car and other 
front obstructions, using the foreground image from the video camera installed in car 
anterior part, without measuring the distance between precedence cars in view of the 
conventional trouble mentioned above. 

[0008] Moreover, this invention aims at offering the front monitor approach for cars of 
having enabled it to recognize migration of the same point at a high speed as an 
optical flow for every predetermined time in the foreground picturized with the video 
camera. 
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MEANS 



[Means for Solving the Problem] The front monitor approach for cars made by this 
invention in order to attain the above-mentioned purpose Picturize a foreground from 
the self-car it is running, and it recognizes as an optical flow based on the image of 
two coma which carries out migration of the same point of this picturized foreground 
before and after a predetermined time phase. In the front monitor approach for cars 
which supervises the precedence car or obstruction to a self-car based on this optical 
flow, it is characterized by judging danger with the magnitude of said optical flow of 
the point of said precedence car or a failure lifter. 

[0010] The long and slender aperture centering on one of them is set up in the 
direction of a radial to one point noted from the infinite point corresponding to one 
point which shows the travelling direction of the self-car it is running in the above- 
mentioned front monitor approach for cars in the image of before in the image of two 
coma carried out before and after a predetermined time phase. It is characterized by 
asking for total of the absolute value of a brightness difference with the aperture in the 
image of said front, and asking as an optical flow of one point which pays its attention 
to the movement magnitude of an aperture when this total becomes min, moving this 
aperture in the radiation direction from said infinite point in a next screen. 
[001 1] In the above-mentioned front monitor approach for cars, it is characterized by 
searching for a brightness difference by the image of two coma carried out before and 
after a predetermined time phase, and asking for an optical flow about the point 
beyond a fixed threshold with this brightness difference. 

[0012] In asking for an optical flow, in the above-mentioned front monitor approach 
for cars, it is characterized by removing the optical flow produced from the scenery 
outside a road, the lane of a road surface, an alphabetic character, a notation, etc. 
[0013] In asking for an optical flow, the field equivalent to the scenery outside a road 
is set up beforehand, and it is characterized by not processing the this set-up field. 
[0014] It has the video camera which picturizes a foreground from the self-car it is 
mnning, the height from the lane on the road surface which the optical flow has 
produced based on optical flow information, an alphabetic character, a notation, etc. to 
a video camera is found, and this height is characterized by removing the optical flow 
which is in agreement with the height of the camera from a road surface. 
[0015] The field appointed beforehand is divided into two or more areas, weighting is 
carried out for every area to total of the die length of the optical flow vector which 
exists in each area, and it is characterized by judging the degree of risk with this value 
that carried out weighting. 
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[0016] A predetermined threshold is set up for every area and it is characterized by 
judging the area where said total of optical flow vector die length by which weighting 
was carried out exceeded this threshold to be dangerous. 

[0017] Said threshold consists of number level and it is characterized by judging the 
level of danger with the level of the threshold which said total of optical flow die 
length by which weighting was carried out exceeded. 

[0018] It is characterized by emitting an alarm according to the magnitude of the 
danger searched for. 
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OPERATION 



[Function] Since he is trying to judge risk paying attention to an OPUI cull flow 
becoming large with the magnitude of the optical flow of the point of a precedence car 
or a failure lifter on the street so that relative velocity is so large that distance with a 
precedence car or an obstruction is small according to the above-mentioned approach, 
it is unnecessary to form the range finder for measuring the distance between 
precedence cars exceptionally. 

[0020] An optical flow sets in the image of the front of the images of two coma paying 
attention to being formed in the direction of a radial from the infinite point 
corresponding to one point which shows the travelling direction of a self-car, Setting 
up a long and slender aperture in the direction of a radial to one point to note from the 
infinite point corresponding to one point which shows the travelling direction of the 
self-car it is running, and moving this aperture in the radiation direction from said 
infinite point in a next screen It asks for total of the absolute value of a brightness 
difference with the field of the image after lapping with the aperture and this aperture 
in an image of said front. Since he is trying to determine the arrow head which 
connects between each central point of the location of an aperture when this total 
becomes min, and the setting location in the image in front of this aperture as the 
optical flow of one point, it becomes mitigation of computational complexity and 
processing can be accelerated. 

[0021] since a brightness difference be search for paying attention to there be a 
location which do not have time brightness change like the empty include in an image 
or a road surface by the image of two coma carry out before and after a predetermined 
time phase and he be try to ask for an optical flow about the point beyond a fixed 
threshold with this brightness difference , the number of the points in the image which 
ask for an optical flow decrease sharply , and can accelerate by become possible to 
exclude useless processing . 

[0022] In order to remove the optical flow produced from the scenery outside a transit 
schedule lane in asking for an optical flow, the field equivalent to the scenery outside 
a transit schedule lane is set up beforehand, and since it is made not to process the this 
set-up field, the processing time is accelerable. 

[0023] While becoming possible to be able to process only the optical flow produced 
only from the vehicle besides the front, and the obstruction by having the video 
camera which picturizes a foreground from the self-car it is running, finding the height 
from the lane on the road surface which the optical flow has produced using optical 
flow information, an alphabetic character, a notation, etc. to a video camera, and 
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removing the optical flow this whose height corresponds with the height of the camera 
from a road surface, and to get to know danger using an optical flow The processing 
time is accelerable. 

[0024] Since the field appointed beforehand is divided into two or more areas, 
weighting is carried out for every area to total of the die length of the optical flow 
which exists in each area and existence of risk is judged with this value that carried 
out weighting, it can know in which location risk is. Moreover, a predetermined 
threshold is set up for every area, the area where total of optical flow vector die length 
exceeded this threshold is judged to be dangerous, and sweet red bean soup with 
mochi can do danger for every area. Furthermore, a threshold consists of number 
level, and he judges the level of danger with the level of the threshold which total of 
optical flow vector die length exceeded, and is trying to emit an alarm according to the 
magnitude of the danger searched for. 
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EXAMPLE 



[Example] Hereafter, the example of this invention is explained based on a drawing. 
Drawin g 1 shows the configuration of the equipment for enforcing the approach by 
this invention, the video camera with which 1 picturizes a foreground in this drawing, 
and 2 input the image obtained with the video camera 1 , and the processing unit which 
performs the image processing mentioned later, the speedometer with which 3 
measures the rate of a self-car, the processing unit which 4 inputs the image- 
processing result of a processing unit 2 and the self-car rate obtained from a 
speedometer 3, and performs danger judging processing, and 5 are alarms. 
[0026] Drawin g 2 is drawing for explaining change of the foreground image obtained 
with a video camera 1 , and the image which the video camera 1 picturized by time 
amount t in the situation containing the self-car which shows (b) to (a), and the image 
which picturized (c) by time amount t+delta t are shown, respectively. 
[0027] Now, a self-car presupposes that the flat path is gone straight on. For example, 
if the road sign and building which are shown in (a) are observed, an image as shown 
in (b) and (c) in time amount t and time amount t+delta t by the passage of time will 
be obtained. If they are connected in search of the point of corresponding in this image 
of two sheets, a velocity vector as shown in (d) will be obtained. This is an optical 
flow. 

[0028] These optical flows appear in a radial from one point called FOE in an image 
(Focus of Expansion) here. It corresponds to one point which shows the travelling 
direction of a self-car on an image in FOE when it is called an infinite point or a 
vanishing point and the car is going straight on. Thus, the optical flow called for when 
the self-car is running is the direction of FOE to a radial. The optical flow emitted 
from the precedence car here includes the information which consists of a location of 
the precedence car to a self-car, and relative velocity, and it is considered that danger 
is high, so that an optical flow is long. 

[0029] Next, the detail is explained with reference to drawin g 3 . optical arrangement 
of this drawing — if it is and 1 1 considers as the lens of a video camera, and the point 
corresponding to [ 12 / f / the image plane of a video camera, and / corresponding to 
one point of the arbitration of a precedence car or a failure lifter in the distance from 
the lens 1 1 to the image plane 12, and P (X, Y, Z) ] the point P on the image plane 12 
in p (x y) — from the ratio of similarity of three square shapes x=f-X/Z .... (2) 
It becomes. 

[0030] If this formula is transformed and time amount differential is carried out X — 
(deltax/dehat-Z+x-ZO/f .... (3) 
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It becomes. Moreover, the x direction components u of an optical flow 
U=deltax/deltat .... (4) 

It comes out, and since it is, this is used. Z=(f-X' - x-Z')/u .... (5) 
It becomes. 

[003 1] Here Relative velocity of a Z - precedence car thru/or an obstruction and a 
self-car = -alpha .... (6) 

Since come out and it is, it is an upper type (5). Z=(f-X'+xalpha)/u .... (7) 
It becomes. Therefore, the x direction components u of an optical flow u=(f- 
X*+xalpha)/Z .... (8) 

It becomes. It can be similarly found about Y. 

[0032] Therefore, from a top type (8), as for x components of an optical flow, the 
relative velocity of size, i.e., a precedence car, becomes large so that Z is [ the distance 
to smallness, i.e., a precedence car, or an obstruction ] smallness, or, so that alpha is 
size. This is the same also about the direction of Y. Therefore, an optical flow 
becomes so long that so size [ relative velocity ] still that it is **** in distance with a 
precedence car etc., and the direction when longer than the time when an optical flow 
is shorter than this is considered that the danger over a precedence car or an 
obstruction is relatively large. 

[0033] By this invention, use that the sense of a radial is asked for an optical flow 
from FOE, he is trying to ask a high speed for an optical flow, and the approach is 
explained below based on drawin g 4 . 

[0034] Drawing 4 is drawing having shown one example of the approach of asking a 
high speed for an optical flow. First, a long and slender aperture is set up in the 
direction of a radial from FOE to one point first noted in the image in time amount t 
( drawin g 4 (a)). Next, it asks for total of the absolute value of a brightness difference 
with the aperture in time amount t in the image in time amount t+delta t, moving an 
aperture one point at a time in the direction of a radial from FOE. And the movement 
magnitude of an aperture when total becomes min is calculated as a velocity vector of 
one point to which its attention is paid ( drawing 4 (b)). In addition, the above- 
mentioned brightness difference is a thing between the pixels of the corresponding 
location shown in (a) and (b) by O about each pixel which constitutes an aperture. It 
can ask for the optical flow of the whole image by performing the above processings 
repeatedly in all the points of the image of time amount t. 

[0035] Moreover, by the conventional approach, when corresponding apertures were 
compared, the cross-correlation value was used. Since total of the absolute value of a 
brightness difference is used by the approach of this invention to it, it becomes 
mitigation of computational complexity and processing can be accelerated. 
[0036] Further, it is asking for the velocity vector from not all the points in an image, 
and a difference is searched for and it is made to process by the image of time amount 
t and time amount t+delta t in this invention only to the point beyond the fixed 
threshold which is the difference. 

[0037] Generally, the image which projected the foreground during car transit has 
many locations which do not have a time brightness change like empty or a road 
surface. Asking for an optical flow theoretically is impossible in such a location. 
Therefore, like the approach of this invention, within the image in time amount t, and 
the image in time amount t+delta t, if it is, it is accelerable by becoming possible to 
exclude useless processing by [ which is a brightness difference ] processing paying 
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attention to things. 

[0038] A high speed is asked for an optical flow by approach which was mentioned 
above. However, the optical flow produced by what is not obstructions, such as 
scenery other than a road and a lane of a road surface, is contained in the optical flow 
which was able to be found here. Therefore, it is difficult to search for the danger by 
existence of a front obstruction or its obstruction using the optical flow currently 
called for here. Therefore, it is necessary to remove the optical flow produced from the 
scenery outside a road, or the lane of a road surface. Next, this approach is explained. 
[0039] Drawin g 5 is one example of the approach of removing the optical flow by the 
scenery outside a road. The location where the slash is drawn in this drawing shall not 
process in the other location noting that it shows a path on the street, by carrying out 
like this, since it begins, the optical flow produced from the scenery outside a road 
cannot be found addition — and the processing time can be 

accelerated by restricting a field. 

[0040] Next, how to erase the mark on a road surface is explained using drawing. 
Drawing 6 is one example of this approach, and explains an optical configuration first. 
Drawing 6 is drawn instead of the car which installed the video camera going straight 
on, assuming that the whole road surface has approached. The lens of the video 
camera with which 1 1 picturizes the front, and 12 show the image plane of a video 
camera. 13 and 14 express the lane before and behind migration. The three-dimension 
coordinate which makes the core of a lens a zero, and the two-dimensional coordinate 
which makes Above FOE a zero on the image plane 2 are considered. 
[0041] The height to the video camera of the lane where the optical flow has produced 
the location of the lane before migration like [ similitude ratio / of two square shapes / 
three ] a formula (1) in P (X, Y, Z+deltaZ) and a Z direction if the location after 
deltaZ migration is set to Q (X, Y, Z) can be known. 
Y=y2 delta Z/fdeltay .... (9) 

The optical flow which height is in agreement with video camera quantity, that is, has 
produced by the mark on a road surface etc. is removable using this height information 
that was able to be found. 

[0042] Here, deltaZ is the distance which advanced between time interval deltat of the 
image of two sheets, and it can ask for it by getting to know a car rate. It becomes 
possible to remove the optical flow produced from other than the front obstruction by 
processing which was explained above. Therefore, a front obstruction becomes 
possible [ searching for the danger which shows how much it is risk ] from the 
location and die length of the optical flow left behind now. 

[0043] Next, how to search for danger is explained. Drawing 7 shows one example of 
this approach. If a configuration is explained first, each field of I -IV shows the distant 
place of a self-lane, the method of Kon of a self-lane, the distant place of a next door 
lane, and the method of Kon of a next door lane, respectively. Weighting of the danger 
is carried out for every area to total of the die length of the optical flow which exists in 
each field, and it is searched for here with this value that carried out weighting. 
Furthermore, the predetermined threshold is set up for every field, and if total of flow 
die length exceeds this threshold, it will be judged that the field beyond a threshold is 
dangerous. Number level setting of the threshold is carried out, and the level of danger 
can also be judged. 

[0044] It becomes possible to be able to demand cautions from an operator by 
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sounding an alarm at the end according to the magnitude of the danger searched for. 
Moreover, it also enables which field to indicate whether how many to be risk on a 
display. It is also possible to change classes, such as a tone of an alarm, with risk level 
furthermore. 

[0045] If the procedure of the image processing by the approach of this invention 
explained above is summarized and shown, it will become like drawing 8 . First, the 
image in time amount t is captured in step S 1 , and then the image in time amount 
t+delta t is captured in step S2. After that, FOE is set up in step S3 and a processing 
field is set up in continuing step S4. Then, it progresses to step S5 and the field where 
the brightness difference exceeded the fixed threshold by the image of time amount t 
and time amount t+delta t here is extracted. It asks for an optical flow in the field 
progressed and extracted to step S6 after that, an optical flow path on the street is 
removed in the following step S7, and danger is calculated with the value which 
carried out weighting for every area in the following step S8 further. 

[Translation done.] 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing an example of the equipment for 
enforcing the approach by this invention. 

[Drawing 2] It is drawing showing the foreground which the video camera of drawin g 
i picturizes, an image, and the optical flow obtained. 

[Drawing 3] It is drawing for explaining the method of detection, such as an 
obstruction by the approach of this invention. 

[Drawing 4] It is drawing for explaining how asking for an optical flow by the 
approach of this invention. 

[Drawing 5] It is drawing showing an example of the field set up in order that an 
optical flow might ask by the approach of this invention. 

[Drawing 6] It is drawing for explaining the method of removal of the optical flow by 
the lane on a road surface by the approach of this invention. 

[Drawin g 7] It is drawing showing an example of the area divided in order to judge 
danger by the approach of this invention. 

[Drawing 8] It is drawing showing a series of processings of the approach of this 
invention. 

[Drawing 9] It is drawing for explaining the trouble of the conventional approach. 
[Description of Notations] 

1 Video Camera 

2 Four Processing unit 
5 Alarm 



[Translation done.] 



http://www4.ipdLncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



Drawing selection |drawing 1 "TJ 



Page 1 of 1 




mmmm 



[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



1/12/2005 



Drawing selection j drawing 2 ' jij 



Page 1 of 1 




Page 1 of 1 



Drawing selection L^^^wing 3 h| 



Y 




[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



Drawing selection | drawing 4 jgj 



Page 1 of 1 




[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



1/12/2005 



Page 1 of 1 

Drawing selection [drawing 5 ^ 




[Translation done.] 



http://www4.ipdl.ncipi.go.jp/c'gi-bin/tran_web_cgi_ejje 1/12/2005 



Page 1 of 1 

Drawing selection j drawing 6 |U 




[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi__ejje 1/12/2005 



Page 1 of 1 



Drawing selection |<^''awing 7 _ _^ 







I 






IV 




n 







[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



Drawing selection |drawing 8 



Page 1 of 1 



S 1 



S 2 




S2.^ia t+AtrcD 



S 3. F O E Oift^ 



S 5.^K t t^m t +A t 



[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



1/12/2005 



Page 1 of 1 



Drawing selection [drawing 9 ^ 



Wi 




(a) (b) 



[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 1/12/2005 



(19) B*Hitfff;t (jp) (12) ^ ^ 4^ 1^ ^ ^ (A) aimmmm^jkmm^ 

#^¥6-107096 

(43)4iBBB 6 ^(1994)4^193 

(51) Intel.' mwmn ;tf*3SE3a#^ f i msmTF^mm 

B 6 0 R 21/00 C 7812 -3D 

G 0 8 B 21/00 H 7319-5G 

H 0 4 N 5/225 C 



(21)tiliS#^ 


!KfS¥4 -256268 




000006895 










(22)fflSB 


5Pfig4^(1992) 9 ^250 




^t?«KHffl 1 Tg 4S28# 








MA 








SC^tCH^&rfrAWUrr 3-14-18 








mm msi 








t*^ill{^«ISTtr«Jt:KAg«3 -16-34 








«ilffl;j!f-5^WN-fiyD«201^S 
















»iii9m^fflm«#i-7-i ^mmw^ 














(74)f^aA 


mm mm (^i«) 











(54) *Mfflfttf:;^i£«:^fe 



(57) mm: 

T^^- :^ ;U :7 D - ^ (r S o TilK^I-coam-^SSS 



4 





Ml 




ml 










la 







o 



—687— 



(2) 



6-107096 



flfriE5fefT*llX«lfS±|S^§«&±C0j^lcM L-T3SnS:t 7" 

n®+'iL^;^cra^&i^.s^^^«J^£ 1 ;S®*y'T--i' a- 1 

[»*JS3] m^l*W«tt«-r^2nv©ii3«raT& 
^©WS^^^iS). ^WSMd^feS— 5£03L€l>{B«S 

S (Wl(,.,) XW2u.T) ) / (SW 

1, w2i^© (x, y) mm<Dmi]-v&^<. 

[0 0 0 4] 



^« 1 IS«©*Wffl*ft;^S«7^S. 

iE:t ^/t^-c o-©s$ ®ijfg?n*ts L-^ t^fii^e^ 

*;V'7D— ©fi3©i|®fa*ti8^fcL^viffi©i^ 
[f»:*:5iO] ^8&e.nfc^Sg^S©:*:#3lcaeoT» 

-5 n t &#mfr.5W*JS 9 ffi«©*:iig«ti};^ 

[0 0 0 1] 

T. <M©^ff©IS{cW:*©*MXttl$$#lS:«i»L3S 

m.m\zm'^^^^^tcisb<D-m^mm:)3^W3m\zm-t^ 

fe©-e*-5. 
[0 0 0 2] 

[«E5(E©S*fl] ti£3l5, ^©a©>&j*tbT. 
¥2 - 2 4 1 8 5 5-^i;^a{Cffi^$nfcfe©*«*S. H 

SJg:Kb. C©fi:^bfc9aS©l^— ;S©SH&&0TS^ra 

yVyu-iimrflMm ©«MffiSt SrM^-T 2. fEKI-fe 
S t (c e «M fcMf 5 5fefT*iiB©fi:g. 

[0 0 0 3] :i-:?''7^-c*Jl'7a— ***s:fcs6 

\z. mk. 2 3-7®iiiisraT^*jis-r-2);^*ifeai-r-5-7>;/ 

y^mt.. 0 9 (a) tC^f^iC t (C:telt-51ii»-htc45 

viT«a-r-5Bi^pic:Mb^wi stD, mm.n±WL-x 

tt^ a©® J® fr*H>St?£5^Bi b 75;*^ e. ffiHffl Stf-^ L, 
0 9 (b) (C*-r<fc5tC, |g0iM*<S;*i:t;fa:ofc^W2 

®PQ (^^) *«:t>'-xwA;i^:7D — tl^iS, ±?Effll8 

1» (..,) X2W2» (X.,) ) 

(1) 



m^rctb\zm^mmL<Dmms^m^mi^-r^rciit)(Dmm 

[0 0 0 51 ^fi. ^t'f'r^-hyvyu — ^-^isb^l^^ 
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3 

[0 0 0 6] '^-dx. ^m-mdt)m^\zis.^tz.ibmmmit 

^ i; T ^ t 1 o ;t ^: t ^ KSfj-r ■£) ;i t 
[0 0 0 7] ^oT*^Bj«, ±miyrz^m(ommj^{z 

[0 0 0 8] h'5^:f;^;;<^Tffi»L.fcS9 

gfc:fev^T, mi^mmm\zm-A(OJ»m'&:t-:f7-^i3)i' 

ya-t U Tiii iitwSglffit- -5 ^ t Ji^t?^ -S J; 5 b fc* 

ii5fflW;?E«;^^&att-r -5 c t e w t LTv^s, 

[0 0 0 9] 

^^mizJ:or3i^ntzmmmm:&^^:^miit. mnvx 

-^^iiizmm-mizM-r^^n^mxi-immiSi'Simm-r 
^mmmm:^mm.:^miz^^^x, m^9cffmmxitmm 

ife±©^cci mfa:t 7^7" ^ ;<j 7 D # $ J; 0 fe^ 

[0 0 10] ±|B»pfflfitf:35^^^^*tC:fcViT, 
frbTVi-S a*WcDjlff ^rifijs^^-r 1 ^»c*tJS-r-5ilK 

m^ii^i^mm-r^iA\zMvxmm^<o:tii^iz^<oiA 
m'b\zf3.^fct^(Dm<D^m&^mm-r^ 1 ^<D:ff'f- 

[0 0 1 1] ±fB*Mffltifi^S«;?S*l':feViT, m^f^ 

$>^—i^(DV^\^m^mx7t}^iiZ-:)\,^X't:/v^^ti}Vy 
[0 0 12] ±ls*ragfflm*M«*i*fcfeViT. yi-:f7- 



(3) i|#Hsp6 - 1 0 7 0 9 6 

[0 0 13] Ti-'/'T-^ ti)iya-^jStfy^\zmft-Dxm. 
[0 0 14] 5tffL'TViSa*M3&^^.m^*»«-rSf 

[0 0 15] ^iie))ei6:rc®«KSr1S»«)K«tC^i-tt, 
mzWiE-r^-^-:fy^'< ij)Vyu—^i; h;p©g$©)^fa 

[0 0 16] ^K««tCBlf^OU^V^llSI9!3£b, Mt3 

b ^ V^tt i^jffi^fcK^^^^ t^sj Wr-r S ^ i: 
[0 0 17] t3IBb#ti<B*i®:^'<;i'Ai?>!&f3, S9f3a 

[0 0 18] d*«)e.nfc)B:g^^C5:*:-^SiwfieoT»^€: 

-5 ;i t t LTt> So 
[0 0 19] 

u~miz^<tt^z.t.\zmm\.x. m}Mmy.\-m±M 

•5. 

[0 0 2 0] •^•:f7-^*)Vyu—ifi^Mm<r>mfr:}j^^ 

ji6-r-5«^RBi^;i^*^e>, l;^^^3*fbTSS:l^^*o:s• 
|6]^ciiffls^>«S:^^b, «roHffifC*3ViT«5^Siifl3#S 

40 m.tw&\zmi3i^^ii(Dmm.(om.m^oynmM<r>mMm. 
ff AS. 

[0 0 2 1] ilf»(^IC^SnS^^8SM(0<t5(Z^ra6<) 
50 — **J6-5J;5{CbTVi5«-(?, :t::^T-.Y A;!'^ o-£ 
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(4) #H^6- 1 0 7 0 9 6 

5 6 

<'ct ^Mfii tfs,r^ ^mittmTL^ o ^m^^ti mmM s^^e^^e^n^a * li^iis t^^xtii. 

[0 0 2 2] :^'f^^ii)vyu-^ikisb^\z^tL'DxM xM^mm^^m^rx'DmM^mmw. b\tmmmmx 

^w^^^^tc.it\zmr^^m^^(ommz.i^^'r^mi^ [0026] m2\t,. \L'f^ti^'7i (c<fcoT#^ns 

[0 0 2 3] ^fTL.TC'^^g*i^;o^^wm^s«i-^bf tmm t xm^vtzMm. (c) ti^rat+At-raife 
:f'r^ij)vyu—i)^^\::^x\^^^^m±^(DMm:^'X^.u 10 [0027]^, ^Mmt.^m.-u.^^nmiyX^^^^hT 

mt^^(^ti:^'y<DM^^—m\^X^^^^^'T-(ti)Vyu m^(omm\z^r^m^t . ^ra t + A t tc:fev> 

—^u=&'r^:it\z^yy. wz^ffi*, [©w«^co^;&^e>^ T, (b) , (c) \z^'^n^^'DfsMmi)m^n^. 

-t^^^tijvyu—^m^^x^mm^^^z.Li^m l (d) \z^^ti^^on.m&^^V)vtm^n^. c 

[0 0 2 4] ^^m^r^mi^^m^<D^i^\z^\,f. [002 s] ^^-ecine>:^y-7^-^:^;u:7D— [i, ®# 

*StC??«Ef'&:ty^-<;^;i/:7D— <DS$(D)^^n(;i*fbT pMOFOE (focus of Expansion) t^litl^ 1 j^f)^^ 

^^mzm^m-fv. :i<Dm^mfvrc.m\z^-DXMm n^mzmn^a foe^:^^, Mmmj^y.\tm^M.t^ 

(DWtE^mmi^x^>^<Dx. E(o^m\zMm^^^i^^^ 20 m^timm\^x\^^m'^mm±.\z^^^x^'^m(r> 

^^z.ti}^x^^. ^r:i. &]z.mmzm^<Dh^^m^ jtff:&fpi^£*r i^tc^tusr^o z.(d^viz. s^mf)^ 

^^m^m:^rcm^^iu.mt:mmi^m^^mz^m&^v FORf)^^nm^(D:^\^x$>^. z.z.x9cnMm:^^^^ 

^g^ScO>t€^JC«eoT»«^5g-r^cfc3l3L.TV>^o [0 0 2 9] -^C03¥iffiB^^ 3 bTI^£^'r 
[0 0 2 5] I^l^c?5^^»ffie:feViT, 1 l^lh'5=':t;^^5co^' 
-r^c ^ Ui*%0>^tCcfc^:^?i^SI5S-r^;^c56oD^g(7) yX\\is^^^:^ — -J':fv->\2'^x<n^m.. p 

(^^tc:fet.^T. n3:SuJa<£r}HS*r^fc'7':t (X, Y. Z) t^5fefT*P^3Cl^l?S'Kr±<;)fiElcO 1 
2n.\i'f^ti^'7\\Z^'DXm^nfzMm.^K p (x, y) ti-r^^-v^^^l^-^l 2±<7);^P^'*fJ^;'r 
x= f • X/Z (2) 

^;/5:^o ^ ^ [0 0 3 0] Cco^C^^J^bT, ^W^iJ-'TSch, 

X' = (Ax/ A t • Z + x • Z' ) / i (3) 

:t':fv^>^i:)Jiyu—<DK:^\^^^uL\t 

u = Ax/A t (4) 

Z= (f • X' -X • Z' ) /u (5) 

tu^o * * [0 0 3 1] 

Z* =9cffmmf3:i^^hmW^tJ^:^mt<DmMmm=- a (6) 

X^^f}^^±^ (5) \t 

Z= (f - X' +x a) /u (7) 

t:fs,^o ^'DX:t':f'T4 t})iya-'<DK:^\^^^i^u\t 

u= (f • X' +xa) /Z (8) 

t:f3i^o Y{zr::>^^xhmm\zjR^^a tj)Vyu-(DK^^\ti^^<U^o cn\tY:^\^\z 

[0 0 3 2] J:'3T±iC (8) zm\ T^*:?^ ':::'ViTfera«T&^c «EoT, :t:/7'>t 1:JJVyu-\t9c 
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(5) 

7 

[0 0 3 3] ^fgPjTfi, ^-r'r>(ti)\^yxi-'if^YO'E 

[0 0 3 4] m^\t. nm\z^':ff->(ti)V'Vu-^^ 

ItttcD^fplfca:^^.^^^^^^-^ (04 (a) ) o ^ 

tvxjK^iE>n^ (m4 (b) ) o ;^*5. ±mm&m 
M^m^-r^^mmiz^^^x. m^\^ (a) s:r; 

[0 0 3 5] ^;^c> Mft>t^^m±^ 

[0 0 3 6] ^mmx\tmz. mmiHo:)±x(D mzMi^ 

m^mpLrc,j^rcwzM{.mm^ffo^v\zi.x^^^. 
[0 0 3 7] -mz. ^mMn^\z^m^^i.rzmm\z 
\t. ^'^^mo:>^^\zmmKunmm^ti^^ys:^^mmf)^^^ so 
v>o z,<D^vumwixu. mmmz:t:fy^^ti)i^yu— 

^ V \z. mm t x(Dm§ktmm t + a t x<Dmmp^x. 
mmm<D^^t:Lh\zmmvxmm^ffo:ih\zj;:D. * 

Y = y2 AZ/f Ay 

CX\^^^:t:/y^4ti)Uya'-^m^'r^z.Lf)tX'^^o 

[0 0 4 2] Az\t2^<Dm^(ommmmA t 
<Dm\z^mi^rzmmxs>y). mmmA^^^^^^z^^ 40 

ilt}sb^^t,t^X^^o ^l.mMVti^'^fs.9SM\z^'D 

X. m-^<nn^m&.m^^^cx^^^:^^'T^ti)vyu 
[0 0 4 3] mz. lu.mm^^^^-^mz'D^^^xmm'r 



#IB¥6 - 1 0 7 0 9 6 

[0 0 3 8] ±MVtz^ofs.-1jm\z^^x. KMtc^T" 

':^rfT^ti)Vyu—\zU. 3lK£il^1^o®S^Sf&fficD*sl 
<i: coia?g^Ki"Cli ;^ i.^ fe<o ic cfc o UT § :t 

^^^:i'^'7-^ti)vyu-'^m^^xm-jj<Dm^^<D^tE'x 
\t^(Dm^m\z^^i^m&^ik^^ z. tJitmmx$>^o 

iz^^^xmrn-r^. 

[0 0 3 9] mb\t. mmsn'<Dm^\z^^:t':f^>rti)v 
ya-^f^^T^:^m(D—mmMx^^. mm\zi5^^x 
^mf3^^\f}^nx\^^^iiLSi^^. iiK±^^LTv>^^u 

m^^mm'r^zt\zj:r)^ mmmmo^mmitfim^^ 

[0 0 4 0] ;k\z. ^m±<D'^'-^^m'r:^mz'-::>^^x 

y':ttJ:/^y(DUyX. 1 2 titf5':t^;< ^c^-f i^:/ 
k->$^-ro 1 SBit/^l 4JiafE(r9(r^c^*ilSr^UT 

i?r?'l^-> 2 ±T±fBF OE ^S^<ht*^ 2 ^*:7cffig=^: 

[0 0 4 1] ^mmommo^m^p (x. y, z + a 

Z) , Z^^fRjtCAZ^ift^COffig^Q (X, Y, Z) L 
:/'r'<tl)i^yU'-<D±CX^^^mm(D}:^y':tt}^^^X 
(9) 

ti;vyu-a:>^^ (Dm^^zMhX&^i^mzm^m'f 

fe^iiww^n^c v^\^^i&^s^]y^)im^iyx^^. 
&^m(D u^ji^^mwr-r^ z.Lhx^^o 
[0 0 4 4] s^tc, jRib^nrzi&mm(D±^'^\z^'o 

XWm^m ^'TZ.tlZ^'O TaiK#tr*f LamS:{£li:^ 

mi'^Mz^Dmm<D'§Bf3:£<Dmm^m^^ z-th^^ 
mxs>^o 

[0 0 4 5] &.±mmLrz^^m(D:^mz^^mmmm 



(6) 



^m^6-l 0 7 0 9 6 



10 



xnmm^-'&<Dv^^m^mxr:imi&^mm^^. t 
^^x^^i^mizm^anvr^mizjz'Dxm.^m^mwr 

CO 0 4 6] 

mm<Dm^] sj.±mmi^T:i^viz:^mm\z^n^-i. m 
:^wm^(DW^jL\t^(Ditmm^^W}m\znmx^^rc 

CO 0 4 7] mz. ^nT^mx\tmsm±(Djs.<D:t:fv^ 

>fti)Vya'-<D:k^'^\z^r)f^^^mWrr^<^'D\zhX 

m^^^r^isb<Dmmm^m^f^ii^-^^^u<ysi'oxi^^<D 
X. i&zi7.hxmm^mxi&^o 
CO 0 4 8] ^rc. i^wmomm. mws::f3i!&m^mm. 



CO 0 4 9] W.\Z. ^fk}^ig(.&XS^<Dm'^^>^^^Xm 

w:f3:mm^^T^:itf}^x^^u^<D^^t)m^n^o 
mmoymmrsiwm] 

Lmi] :^^m\z^^:^m^mm'r^rzsb(Dmm<D—m 

C0 3] y^^m<D-^mz^^mw^ys:^<Dm.m<Dti::b^ 
mmT^r:i^<Dmx$}^o 

10 C0 4] :^%m(D:f3m\Z^K>:i'^'T^ti)Vyu-(D^^ 

C^5] :^nm<D:^m\z^r>:t^^^ti)Vyu—<D^isb 

^fz.}sbm^vf:imm<D—m^^^^x:sb^o 

ci^7] :^mm<D^m\z^^^^m^n^'r^rz^^n 
tcUM.<D—m^7^tmx-$>^. 

c^9] ^^^(D:f5^(Dmm^^mA'r^fz.^(Dmx^ 
c^^^osa?^] 

1 'd'f^fi:^y 

2, 4 iasjassB 
5 mm^w 



C^l] 
2 
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(8) 
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S l.iflffl t 



S2.^lffl t+Atrco 
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#Bi¥6- 1 0 7 0 9 6 



mtHBI ¥*£5^5fl 1 2 0 

i^mwiE 1 ] 

miEM».mm^] mmm 

mJEMM^S^I 0 0 4 1 

Y = y» AZ/fAy 



* [0 0 4 1] ^KiMcD^MtDteMgr P (X. Y. Z) , 
Z^t^lfcAZi^ei^OfeB& Q (X. Y. Z-AZ) 
■r«)tv 2:3©3^lfi^cDffl<Htt:«feDiC (i) ©<fc5C:t 

(9) 



[MttiB] ¥*£5¥5^ 1 2 0 

miEMmmm^] mm 
miEM^^m^^ 04 

[04] 

(a) 



FOE 



(b) 



P, 
FOE 



[^i^«iE2] 

caiErt*] 
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S 1 



S 2 




s i.i^K t rcD 



S 3. F 0 








s i.mm 





S S.l^H t iNrlffl t +A t 



1^* 



—696— 



